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STATISTICAL  PRECISION  AND  ROBUSTNESS  OF  THE  AMSAA  CONTINUOUS 
RELIABILITY  GROWTH  ESTIMATORS 


1.  introduction 

1 . 1  Discussion  of  Reliability  Growth. 

The  U.S.  Amy  Materiel  Systems  Analysis  Activity  (AMSAA)  employs 
the  Weibull  process  to  model  reliability  growth  during  a  development  test 
phase.  Development  test  programs  are  generally  conducted  on  a  phase  by  phase 
basis.  The  AMSAA  reliability  growth  model  is  designed  for  tracking  the 
reliability  within  a  test  phase.  This  model  evaluates  the  reliability  growth 
that  results  from  the  introduction  of  design  fixes  into  the  system  during 
test. 


Figure  1  illustrates  a  typical  pattern  of  growth  on  a  phase  by 
phase  basis. 


Figure  1.  Measure  of  Reliability  (e.g.,  Mean-Time~Between-Fai lures  (MTBF)  in 
Different  Phases. 

The  AMSAA  tracking  model  addresses  the  reliability  growth  within 
a  particular  test  phase.  Several  tracking  growth  curves  may  be  required  to 
measure  reliability  growth  over  multiple  test  phases  due  to  the  incorporation 
of  groups  of  fixes  between  test  phases  and/or  changes  in  test  phase  environments. 

Assume  the  test  phase  starts  at  time  t  =  o.  Within  the  test  phase, 
let  o<ti  <t2<...<tk  denote  the  cumulative  test  times  on  the  system  when  design 
modifications  are  made  (see  Figure  2). 


Test  Phase  1 

Test  Phase  2 

_ ^ ^ ^ _ L_ 

Test  Phase  3 

^  i  1  ^ 

t=0  ti  t2  t3  t4 

Figure  2.  Times  of  Design  Modifications  for  Test  Phase  2. 

The  failure  rate  can  generally  be  assumed  to  be  constant  between 
the  times  when  design  changes  are  made  on  the  system.  Let  denote  the 
constant  failure  rate  during  the  ith  time  period  [ti_i,  t-j]  between  modifica¬ 
tions  (see  Fi gure  3) . 


Figure  3.  Failure  Rates  Between  Modifications. 

The  constant  failure  rate  assumption  during  ti]  implies  that 

for  this  interval,  the  times  between  successive  failures  follow  the  exponential 
distribution  F(x)  =  1  -  exp  (-Xix),  x>0. 

The  AMSAA  tracking  model  approximates  the  step-wise  failure  rate 
function  shown  in  Figure  3  by  a  smooth  curve.  The  parameters  of  this  curve 
are  estimated,  based  upon  the  failure  data  observed  during  the  test  phase. 
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The  objectives  of  our  stud>  are  to: 


a.  Study  the  statistical  precision  of  the  AMSAA  MIL-HDBK-189 
(Reference  1)  mean  time  between  failure  (MTBF)  estimators  M-HAT  and  M-BAR. 

b.  Study  robustness,  i.e.,  the  effect  on  estimator  statistical 
precision  due  to  discrete  configuration  changes  (i.e.,  the  step-wise  dis¬ 
continuous  faibure  rate  curve). 

2.  ESTIMATION  PROCEDURES  ANALYZED 

In  the  subsequent  sections,  we  shall  define  several  important  statistical 
properties  of  reliability  estimators.  We  shall  then  study  these  properties 
for  the  MIL-HDBK-189  reliability  growth  estimation  procedures  applied  to 
time-terminated  testing. 

The  data  used  for  the  analysis  consists  of  the  N  successive  failure 
times  ■fi  ^  ^  ^  occur  during  a  test  phase  of  duration  T. 

The  metriod  oT  maximum  likelihood  utilized  in  the  MIL-HDBK-189  estimation 
procedure  provides  the  estimate  of  the  shape  parameter  $  as 


6  =  - 

N 

N  An  T  -  i  in  f . 
i=l  ’ 


where  in  denotes  the  natural  logarithm  function. 

A  A 

Subsequently,  the  scale  parameter  X  is  estimated  by  X  «N/yB.  It 
follows  that  for  any  time  t,  the  intensity  function  (failure  rate)  is  estimated 

by  '^(t)*  t^^.  In  particular,  this  holds  for  T,  the  total  test 

time.  The  reciprocal  of  ^(T)  provides  an  estimate  of  the  MTBF  which 
could  be  anticipated  if  the  system  configj^ation  remains  as  it  is  at  time 
T.  This  estimate  is  denoted  by^.  Thus  m  *  1/^(T)  *  T/NP.  For  small 
sample  sizes,  it  is  appropriate  to  use  an  unbiased  estimator  B  of  the  shape 
parameter  P.  The  estimator  T  is  defined  in  MIL-HDBK-189  as 


The  estimator  M  of  MTBF  can  be  calculated  by  using  the  unbiased 
estimator  as  follows: 


M  =  T/NB  for  K  >  1 


3.  PRECISION 

Definition;  Precision  of  aT:  estimator  is  measured  by  the  Relative  Error, 
RE,  defined  by 

“  l^(EST)  *  ^TRUE)  '^”(TRUE) 

where  M/cct\  ®  calculated  from  the  maximum  likelihood  estimator  ^  of  ^he 
shape  piiramiter  B  or  calculated  from  the  unbiased  estimator  B  of 

the  shape  parameter  B.'^InHhe  above,  denotes  the  MTBF  at  the  end 

of  the  test  time. 

Since  M.cctj  is  a  random  variable,  RE  is  a  random  variable  and  so  we  can 
consider  its'ciitribution.  This  distribution  can  be  simulated  by  using  data 
generated  from  the  AMSAA  continuous  failure-rate  curve. 

It  has  been  found  that  the  probability  of  achieving  a  specified  precision 
(i.e.,  specified  relative  error)  depends  solely  upon  the  expected  number  of 
failures  (see  Appendix  A).  In  fact,  an  analytical  expression  in  terms  of  the 
expected  number  of  failures  can  be  found  for  the  distribution  function  of  the 
relative  error.  However,  for  our  purposes,  we  found  it  more  convenient  and 
adequate  to  use  simulation  to  estimate  the  probability  that  the  relative 
error  would  be  less  than  or  equal  to  a  specified  value. 

In  our  study  we  simulated  5,000  failure  histories  for  estimating  the 
probability  of  achieving  a  specified  precision  with  n  and  "R.  The  estimated 
probabilities  were  conditioned  on  the  set  of  failure  histories  that  had  at 
least  one  failure.  For  each  simulation  run,  the  number  of  failures  N  and 
cumulative  failure  times  f,,  fyt  *•*  »  '"©corded.  The  total  test 

time  T  was  chosen  to  be  1,600  nour^  5,000  hours,  and  10,000  hours.  For  each 
test  length,  the  MTBF  estimators,  M  and  H,  were  calculated  and,  thereby,  the 
distribution  of  relative  error  was  obtained,  to  analyze  the  behaviour  of  the 
MTBF  estimators.  It  was  found  that  if  and  M  behave  in  the  same  way, 
especially  when  the  expected  number  of  failures  is  moderate  to  large  (see 
Figures  4  and  5). 

4.  ROBUSTNESS 

Definition;  Robustness  is  defined  to  be  the  ability  of  an  estimator  to 
perform  well  even  when  the  underlying  assumptions  are  violated. 

For  the  purpose  of  our  study,  we  considered  a  class  of  step  functions  which 
were  compatible  with  the  AMSAA  tracking  model  and  whose  discreteness  could  be 
simply  characterized  (see  Appendix  C).  In  the  step  function  construction,  the 
steps  represent  the  constant  failure  rates  over  different  configurations.  By 
simulation  the  failure  data  were  generated  from  the  step  function  failure 
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Figure 


Figure  5.  Probability  of  20%  Precision  vs.  Expected  Number  of  Failures  for 


rate  curves,  and  then  MIL-HDBK-189  estimators  M  and  F  were  computed  as  in 
Section  2.  For  both  estimators,  the  distributions  of  RE  were  computed.  As 
defined  in  a  previous  section,  the  RE  is: 

=  l^(EST)  -  f^(TRUE)  l/^(TRUE) 

For  the  step  function  construction,  is  the  MTBF  of  the  system’s  last 

configuration.  From  the  simulation  rtsUTU  for  the  discrete  failure  rate 
curve,  it  was  observed  that  the  probability  of  achieving  a  specified  precision 
strongly  depends  upon  the  expected  number  of  failures  and  weakly  upon  the 
number  of  configurations  £or  about  five  or  more  configurations  (see  Figures  6 
and  7).  Notice  that  the  M  estimator  behaves  in  the  same  way.  It  is  important 
to  note  that  the  probability  of  achieving  a  specified  precision  for  a  finite 
number  of  configurations  rapidly  approaches  the  probability  obtained  for  the 
smooth  AMSAA  failure  rate  curve,  as  the  number  of  configurations  increases. 

5.  APPLICATIONS 

The  following  computational  examples  will  show  how  to  use  the  relation¬ 
ship  between  the  probability  of  achieving  a  specified  precision  and  the 
expected  number  of  failures  to  analyze  an  idealized  planning  curve. 

Computational  Examples. 

a.  Determine  the  amount  of  test  time  to  achieve  a  specified  precision 
with  a  given  probability. 

As  an  example  of  this  type  of  problem,  we  shall  calculate  the  amount  of 
test  time  required  to  ensure  with  a  probability  of  0.80  that  the  MTBF  esti¬ 
mator  ^  will  be  within  20  percent  of  the  true  (unknown)  MTBF,  M(true). 

Typically,  one  attempts  to  develop  an  idealized  growth  curve  that  will 
grow  to  a  desired  value,  Mp.  This  value,  Mp,  may  be  the  required  MTBF,  or  it 
may  be  a  value  higher  than  the  required  MTBF.  The  latter  case  will  occur 
when  one  is  required  to  demonstrate  the  desired  system's  MTBF  at  a  specified 
confidence  level.  In  either  event,  we  will  assume  in  this  example  that  the 
end  point  of  the  planning  curve  has  been  determined  and  denoted  by  Mp. 

Assume  we  actually  grow  along  the  idealized  curve  to  the  end  point  after  T 
hours.  Then  M^jruE)  equal  Mp.  In  this  example,  we  wish  to 
calculate  a  value  for  T  that  will  ensure  with  a  probability  of  0.80  that 
|H  -  M(true) I  <  (0.20)  M(7rue).  This  value  of  T  depends  on  the 
expected  number  of  failures  associated  with  the  idealized  growth  curve.  The 
expected  number  of  failures  required  to  ensure  a  specified  relative  error 
with  a  probability  of  0.80  can  be  found  from  a  family  of  "Relative  Error  vs 
Expected  Number  of  Failures"  curves  (see  Appendix  B). 

It  cc  be  shown  that  the  expected  number  of  failures,  E(F),  may  be 
expresses 

E(F)  =  C/d-ct))  (T/Mp) 
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NUMBER  OF  CONFIGURATIONS 


E(F)=I67 


NUMBER  OF  CONFIGURATIONS 


Thus  for  an  assumed  growth  rate,  for  example,  a  =  0.2,  specified  precision 
=  0.2  and  Mr  =  168  hours,  we  see  from  Figure  9,  Appendix  B,  that  E(F)  =  93 
and  T  may  be  calculated  as  follows: 

T  =  (1  -  cx  )  (Mp)  (E(F)) 

=  (1  -  0.2)  (168)  (93) 

=  12499.2  hours 

Notice  that  for  a  given  Mp  and  E(F),  there  is  a  linear  relationship  between 
the  test  time,  T,  and  the  growth  rate,  a.  The  idealized  growth  curve  that 
corresponds  to  the  specified  growth  rate  of  0.2  and  that  grows  to  the  desired 
MTBF,  Mp  =  168  hours  in  an  amount  of  time,  T  =  12499.2  hours  can  be  completely 
specified  by  using  the  following  relationship: 

E(F)  =  XT^  where  e  =  1  -  a 

Solving  for  x,  we  obtain, 

A  =  (E(F))T-3 

The  equation  of  the  idealized  growth  curve  is  now  completely  specified. 

b.  For  a  given  amount  of  test  time  T  and  MTBF  value  Mp  to  be  achieved 
at  the  end  of  test  time  T,  what  precision  (i.e.,  relative  error)  of  the  m 
estimator  can  be  ensured  with  a  specified  probability  for  a  stated  growth 
rate. 


In  our  example,  the  given  amount 
Mp  will  be  taken  to  be  197  hours.  We 
estimator  that  can  be  achieved  with 
curve  with  growth  rate  a  =  0.3. 

The  expected  number  of  failures, 
using  one  of  the  following  formulas. 

E(F)  =  (l/d-a)!  (T/Mp) 

or 

E(F)  =  XTP  =  XT  (1  -  a) 


of  test  time  will  be  T  =  3542  hours  and 
wish  to  calculate  the  precision  of  the 
a  probability  of  0.80  for  a  growth 


E(F),  can  be  calculated  to  be  26  by 


From  Figure  9,  Appendix  B,  we  see  that  PROB  (RE  <  0.36)  =  0.80. 

6.  CONCLUSIONS 

From  Section  3  regarding  precision,  we  conclude  the  following: 

a.  The  probability  of  achieving  a  specified  precision  increases  as  the 
expected  number  of  failures  increase. 

b.  The  precision  of  and  T*  is  essentially  the  same. 
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c.  It  is  important  to  choose  idealized  planning  curve  parameters  (T,  a,  A  ) 
to  obtain  adequate  precision  (i.e.,  REs)  for  the  estimator  at  the  desired 
probability  level.  In  particular,  we  should  state  the  specified  precision 
(i.e.,  specified  relative  error),  REs,  and  probability  level,  PR,  where 

|M(EST)  -  M(TRUE)  I 

.  <  REs 

M(TRUE) 

d.  For  a  given  idealized  planning  curve  and  test  time,  one  can  calculate 
the  risk  that  the  estimate  will  not  be  within  a  specified  percent  of  the  true 
MTBF,  e.g.,  for  the  specified  percent  =  20  percent 


Risk  =  PROB  (|M(est)  -  M(truE)I  >0-20  M(truE)) 


e.  This  study  emphasizes  the  need  to  include  the  confidence  bounds  on 
the  true  MTBF  when  presenting  evaluations  based  on  the 

estimators.  It  could  be  misleading  to  only  present  point  estimates  in  cases 
where  the  probability  of  obtaining  good  precision  is  low. 

From  Section  4  regarding  robustness,  we  conclude  that: 

a.  The  precision  of  MIL-HOBK-189  estimators  strongly  depends  on  the 
expected  number  of  failures. 

b.  The  robustness  of  and  Ti  is  essentially  the  same. 

c.  For  a  small  expected  number  of  failures,  although  the 

of  achieving  a  specified  precision  is  low,  it  is  robust  with  respect  to  the 

number  of  configurations. 

d.  For  a  high  expected  number  of  failures,  the  probability  is  not 
robust  for  a  small  number  of  configurations.  This  emphasizes  the  need  for 
instituting  Test,  Analyze,  and  Fix  (TAAF)  procedures  for  long  duration  growth 
programs  when  the  expected  number  of  failures  is  high. 
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APPENDIX  A 


DISTRIBUTION  OF  RELATIVE  ERROR 

In  this  appendix,  we  shall  obtain  the  distribution  function  of  the 
relative  error,  RE,  where  RE  is  defined  as  in  Section  3.  It  will  be  seen 
that  the  distribution  function  is  governed  by  only  one  scalar  parameter,  the 
expected  number  of  failures  for  the  reliability  growth  test. 

For  a  time  terminated  growth  test  of  duration  T,  the  AMSAA  continuous 
model  assumes  the  failure  process  {Nt|0<t<T}  is  a  nonhomogeneous  Poisson  process 
with  intensity  function  p(t)  »  XBt®”^  (x>0,  $>0).  The  variate  N^  denotes 
the  cumulative  number  of  failures  through  test  time  t.  The  expected  value  of 
Nt,  denoted  by  E(Nt),  is  given  by 

t 

E(Nt)  *  /  p(s)ds  «  xt®  (1) 

0 


for  t^O. 


Nt 

Let  W  =  ln(T/fi) 
i=l 

where  f^-  denotes  the  cumulative  test  time  to  the  i^^  failure.  The  sum  is 
defined  to  be  zero  when  Nt*0.  In  Reference  2,  the  distribution  of  W 
conditioned  on  Nx*n>^l  is  derived.  This  distribution  can  be  used  to  obtain 
the  distribution  of  RE. 


Let  n>^l  and  let  Up  denote  W  conditioned  on  Ny^n.  Define  fy  to  be  the 
density  function  of  W^.  In  Reference  2,  it  is  shown  that 


(eW)n-le-BW  B 


(n-D! 


for  W>0 


*  0  for  W<0. 

To  further  consider  the  distribution  of  Up,  let  6(r,s)  denote  a  gamma 
random  variable  with  density  function 

g(x)  ■  — — -  x^*le“*/s  for  x>0 
s^r(r) 

■  0  for  x£0 

where  r>0  and  s>0. 

Thus,  Wp  ~  6(n,B"^).  We  may  also  express  in  terms  of  a  Chi-Square  variate 
with  2r  degrees  of  freedom,  denoted  by  xfr* 

G(r,s)  -  (s/2)  xfr 
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(2) 


Thus  by  (2),  with  r=n  and  s=B"l, 

Wn  ~  (1/26)  xln  (3) 

Recall  that  the  maximum  likelihood  estimate  (MLE)  for  6  is  given  by 


/V  Nt 

6  =  Nj/I  ln(T/fi) 
i=l 


(4) 


^  A  A  A 

Let  6n  and  Mn  denote  the  variates  e  and  MTBF  MLE  M  conditioned  on  Nj  =  n>l, 
respectively.  Then  by  (4),  ~ 


A  n 

~ 

A  A 

Recall  M  =  T/6N7  and  thus 

A  A 

^n  “  T/Spn 


(5) 


(6) 


Let  M  =  l/p(T),  the  instantaneous  MTBF  at  the  end  of  the  growth  program. 
Then,  by  (5) , 

VM  *  (xT^/n)  (6/6n) 

BWn 

=  (XTB/n)  ■ 


XTS 

—  )(26Wn) 

2n2 

Using  (7)  and  (3)  we  obtain 


XTB 

>^/H  -I  - 


X2n 


Next,  observe  that  Nj  is  a  Poisson  random  variable. 
By  (1).  E(Nt)  *  XT®.  Thus, 

(xtB)*^ 


Pr(Nj  *  k)  * 


k! 


(7) 


(8) 


(9) 


for  k  ®  0,1,2,... 

where  Pr  denotes  the  Poisson  probability  function.  Also  note 
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RE  = 


(10) 


^  /% 


M-M 

1  ^ 

M 

B 

M 

A 

where  M  denotes  the  MLE  for  MTBF  defined  for  n>^l.  Thus,  the  distribution  of 
RE  is  determined  by  that  of  n/M. 

Let  F  denote  the  distribution  function  of  F^/M  and  let  Fp  denote  the 
distribution  function  of  np/M-for  n>^l.  Then, 

•  Pr(N7*n) 

f'(x)  *  I  Fn(x)  — _  for  x>0  (11) 

n=l  {i-Pr(NT=0)} 


and 


F(x)  *  0  for  x£0. 

By  equations  (8)  and  (9),  we  have  that  Fn(x)  and  its  coefficient  in  (11) 
are  solely  functions  of  XT®  =  E(N7)  for  each  positive  integer  n.  Thus  by 
(10),  it  follows  that  the  distribution  of  RE  is  determined  by  the  parameter 
E(Nj).  Furthermore,  the  distribution  function  of  RE  may  be  evaluated  for  a 
given  value  of  XTP  via  formulas  (10),  (11),  (8),  and  (9^). 
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APPENDIX  B 

SPECIFIED  RELATIVE  ERROR  VS  EXPECTED  NUMBER  OF  FAILURES 

To  generate  the  “Specified  Relative  Error  vs  Expected  Number  of  Failures" 
graph,  we  used  the  family  of  "Probability  of  achieving  REs  vs  REs"  curves 
(see  Figure  8)  in  which  the  expected  number  of  failures  is  constant  for  a 
particular  curve.  These  curves  depict  the  variation  in  the  probability  of 
achieving  the  system's  true  MTBF  within  a  specified  precision  for  the  given 
expected  number  of  failures. 

Most  often,  we  are  interested  in  finding  the  total  test  time  for  a 
specified  precision,  say  0.20,  and  a  given  probability,  say  0.80.  Though  it 
is  possible  to  accomplish  this  objective  by  directly  using  the  family  of 
curves  in  Figure  8,  it  is  more  convenient  to  use  the  graph  in  Figure  9.  To 
construct  this  graph,  we  draw  a  horizontal  line  in  Figure  8  at  a  point  corres¬ 
ponding  to  the  given  probability,  say  0.80.  From  the  points  of  intersection 
between  the  line  and  the  curves,  draw  perpendiculars  to  the  horizontal  axis 
representing  the  specified  relative  error  (REs),  see  Figure  10.  Record 
the  specified  relative  errors  corresponding  to  the  points  of  intersection 
between  the  perpendiculars  and  the  horizontal  axis.  We  know  that  the  expected 
number  of  failures  remains  constant  along  a  particular  curve  and  it  varies 
for  different  curves.  In  this  way,  we  can  collect  data  representing  the 
values  for  the  expected  number  of  failures  and  the  corresponding  specified 
relative  errors.  Then  this  information  is  used  to  construct  the  desired 
curve,  i.e..  Figure  9. 
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Figure  8.  Probabilit 


Specified  Relative  Error  vs.  Expected  Number  of  Failures 


spccinr.'j  RELfvnvE  error  (re 
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CONSTRUCTION  OF  STEP  FUNCTION  FAILURE  RATE  CURVES 
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APPENDIX  C 

CONSTRUCTION  OF  STEP  FUNCTION  FAILURE  RATE  CURVES 

The  total  test  time  T  is  divided  into  s  equal  size  sub-intervals. 
For  each  sub-interval  i  (i=l,...,s).  the  constant  failure  -  rate  is 

defined  as  the  average  value  of  p(t)=  ABt  over  sub-interval  i. 

This  construction  is  represented  graphically  for  s  »  4  in  Figure  11. 


Pj-  HEIGHT  OF  iTH  RECTANGLE 

tj  -  i  (T/s)  s  HT/ii) 


Figure  11.  Step  Function  Failure  Rate  Curve. 
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TITLE 

Statistical  Precision  and  Robustness  of 
the  AMSAA  Continuous  Reliability  Growth 
Estimators 

BRIEFING  REPORTTR  45- 

THE  PRINCIPAL  FINDINGS 


1.  The  probability  of  achieving  a  specified  precision  solely  depends 
upon  the  expected  number  of  failures  when  the  failure  data  are  generated 
from  the  AMSAA  Continuous  failure  rate  curve. 

2.  The  probability  of  achieving  a  specified  precision  still  strongly 
depends  upon  the  expected  number  of  failures  when  failure  data  come  from  a 
finite  number  of  configurations. 

3.  precision  and  Robustness  of  MTBF  estimators  ^  and  F  are  essentially 
the  same. 

THE  MAIN  ASSUMPTIONS 


1.  For  the  precision  part  of  the  study,  the  failure  data  are  assumed 
to  be  generated  from  the  AMSAA  continuous  failure  rate  curve. 

2.  For  the  robustness  part  of  the  study,  the  failure  data  are  assumed  to 
he  generated  from  a  finite  number  of  configurations  whose  overall  trend  follows 
the  AMSAA  failure  rate  curve. 

3.  We  studied  robustness  with  respect  to  the  number  of  configurations  by 
choosing  equal  configuration  time  periods. 

THE  PRINCIPAL  LIMITATIONS  We  used  (MIL-HDBK-189)  MTBF  estimators'  formulas 
under  the  assumption  that  failure  data  are  coming  from  the  AMSAA  continuous 
failure  rate  curve  for  the  precision  part.  We  used  the  same  formulas  to  study 
robustness  with  the  assumption  that  failure  data  are  coming  from  a  finite 
number  of  equal  configuration  time  periods. 

THE  SCOPE  OF  THE  STUDY 


This  methodology  can  be  used  to  calculate  the  required  test  time  associated 
with  an  idealized  planning  curve  to  achieve  a  specified  precision  with  a  given 
probability, 

THE  STUDY  OBJECTIVE 


1.  To  Study  _the  statistical  precision  of  the  AMSAA  (MIL-HDBK-1B9)  MTBF 
estimators  r  and  M. 

2.  To  study  robustness,  i.e.,  the  effect  on  the  estimator  statistical 
precision  due  to  the  discrete  configuration  changes. 


AMSAA  Form  43R  (3  Apr  87) 

Previous  editions  of  this  form  are  obsolete 


THE  BASIC  APPROACH 


1.  To  determine  the  precision  of  the  MIL-HDBK-189  MTBF  estimators,  we  did 
5000  simulations  to  generate  a  distribution  of  relative  error  of  the  MTBF 
estimators.  The  failure  data  were  generated  from  the  AMSAA  continuous  failure 
rate  curve. 

2.  To  determine  the  robustness,  we  generated  a  distribution  of  relative 
error  from  a  finite  number  of  configurations  through  5000  simulations. 

REASON  FOR  PERFORMING  THE  STUDY 


The  study  results  are  useful  for  planning  purposes.  We  can  determine  the  test 
time  for  a  probability  and  a  specified  precision  level. 

IMPACT 


Reliability  growth  plan. 

STUDY  SPONSOR 

U.S.  Army  Materiel  Systems  Analysis  Activity  (USAMSAA),  RAM  Division 
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